Asymptotically inspired moment-closure approximation for adaptive networks 
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Adaptive social networks, in which nodes and network structure co-evolve, are often described 
using a mean-field system of equations for the density of node and link types. These equations 
constitute an open system due to dependence on higher order topological structures. We propose a 
new approach to moment closure based on the analytical description of the system in an asymptotic 
regime. We apply the proposed approach to two examples of adaptive networks: recruitment to 
a cause model and adaptive epidemic model. We show a good agreement between the improved 
mean-field prediction and simulations of the full network system. 
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I. INTRODUCTION 

In recent years we have seen much progress in 
the field of network dynamics and dynamics on net- 
works [1-4]. Strong interest in understanding phe- 
nomena such as disease spread on social networks, 
interaction online social media such as Facebook and 
Twitter, dynamics of neuronal networks, and many 
others have encouraged development of mathemati- 
cal tools necessary to analyze the behavior of such 
systems [5-9]. 

Often the first step in analyzing such systems is 
to represent them as networks, where an individual 
unit, e.g., a person, a user account, a neuron, is rep- 
resented by a node, and possibility of interaction be- 
tween any two units is represented by a link between 
them. The dynamical processes on such networks 
are often characterized by their statistical proper- 
ties via a mean- field approach [10-13]. Such mean- 
field equations consist of a hierarchy of equations, 
where the expected state of the nodes, due to inter- 
action via the network, is coupled to the statistical 
description of links in the network. The dynamical 
evolution of the links in turn depends on the evolu- 
tion of statistical description of node triples, which 
in turn depend on higher order structures, and so on. 
In other words, this mean-field description yields an 
infinite system of coupled equations, which usually 
must be truncated in order to be solvable. The trun- 
cated system is open and has to be closed by intro- 
ducing additional information about the system. 

The dynamics on network systems arc often closed 
at the level of link equations, where the network in- 
formation makes its first appearance [14]. Perhaps 
the simplest closure approach is based on the as- 
sumption of homogeneous distribution of different 
node types in the system, and that the probability 



of finding a particular type of node in the neighbor- 
hood of a given node is independent of what else 
can be found in that node's neighborhood. This 
closure was shown to produce excellent results for 
many different systems [14-19]. The heterogeneous 
mean-field approach, where conditioning on the to- 
tal degree of nodes is introduced, may improve the 
accuracy of the approximation, although drastically 
increasing the number of equations in the descrip- 
tion [9, 20]. Often, additional information about the 
system, such as the expected clustering coefficient, 
may be used to improve the closure [17]. In other 
cases, assumptions about the shape of degree distri- 
bution functions [19], possibly guided by numerical 
simulations or physical observations [15, 21], may 
lead to an improvement in closure. Equation-free 
approaches may also be used when closing the mean- 
field equations [22, 23]. 

All of the above closures often lead to a reasonable 
approximation of the system dynamics. However, 
they all suffer either from the lack of a priori knowl- 
edge of the validity of approximation or from having 
an excessive number of equations that must be an- 
alyzed. In this paper, we propose a new method 
that may lead to accurate closures and that also al- 
lows one to manage the expectation of the accuracy 
of the obtained closure. The proposed approach is 
based on simplification of the mean-field system of 
equations in some asymptotic regime. In the rest of 
the paper we demonstrate our approach by applying 
it to two adaptive network systems, i.e., networks 
where dynamical processes on the nodes affect the 
network structure, which in turn affects subsequent 
dynamics on the nodes [24]. In section II, we de- 
rive a closure for a system modeling recruitment to 
a cause [12]. In section III we derive an improved 
closure for an adaptive epidemic model [10]. 
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FIG. 1. (a) Schematic representation of node dynam- 
ics in the recruitment model. The nodes are born into 
the N-class at rate fi; nodes die at rate 9; the possible 
transitions between the classes are marked by the arrows 
and labeled with the corresponding rates (Ai, A2, 7). (b) 
Link rewiring takes place at a rate w. (c) Example of a 
node triple. 



II. ADAPTIVE RECRUITMENT MODEL 



Our first example is a model for recruitment to 
a cause, introduced in [12]. A society is modeled 
as a network in which some of its individuals repre- 
sent a particular ideology and actively recruit new 
members. These nodes are referred to as the re- 
cruiting nodes, or R-nodes. The rest of the people 
in the society are either susceptible to recruitment 
or non-susceptible, referred to as S- and N-nodes re- 
spectively. The N-nodes may spontaneously change 
their state and become S-nodes, and vice versa, at 
rates Ai and A2, respectively. The R-nodes recruit 
S-nodes at a recruitment rate 7 per contact with 
S-node. A schematic representation of these transi- 
tions appears in Fig. 1(a). The R-nodes can improve 
their recruiting capability by abandoning their con- 
nections to N-nodes in favor of S-nodes, as shown 
in Fig 1(b). This rewiring process takes place at a 
rate w per contact between R- and N-nodes. The 
system is open in the sense that nodes die at rate 9 
per node, and new nodes enter the system at rate /i. 
The newborn nodes are born as N-nodes, and attach 
themselves with links to a randomly chosen nodes. 

In order to describe the evolution of this system, 
we begin with developing a heterogeneous mean- 
field description [20]. We characterize the time evo- 
lution of Pa-k, the expected number of nodes of 
type a with ki, ^2, and k^ neighbors of type N, S, 
and R, respectively, in their neighborhoods, where 



k= {ki,k2,k3): 
dtPN-M = 

^2PSM — ^iPNM^ Spff.\^-\- p5ki+k2+k3,a ., x 
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dtPSM = 

- A2/0s;k - ^ksps-k + >^iPN;k - Ops-k+ 

+ ^ [^S-M-r,{'^i)PSM~ri - ^S;k(?'i)/3S;k] 



(lb) 



dtPR;U = jk3PS;U - 0PRM + 

+ ^ [fis;k-n(?'i)PS;k-ri " ^S;k(?'i)PS;k] ■ ^ ^' 

i 

The allowed transitions and the corresponding rates 
shown in the Table I. In the recruiting transition 
rates listed in the table, function P (function Q) cor- 
responds to the expected number of node chains that 
originate at a given N-node (S-node) with a neigh- 
borhood specified by k that is connected to an S- 
node, which is turn is connected to an R-node. The 
terms A'xi...x„ correspond to the expected number 
of node chains in the system, where a node chain 
constitutes a set of nodes, connected as follows: a 
node of type Xi is connected to the node of type 
A2 , which in turn is connected to node of type X3 
etc. For example, Ns is the expected number of 
S-nodes in the network, while N^is is the expected 
number of links with S- and R-nodes at its ends. In 
our definition of node chains we require the ith and 
i + lst nodes to be different; however, ith and i-l-2nd 
nodes can in fact be the same node. In the example 
of a network presented in Fig. 1(c) there are 4 RSR 
triples, corresponding to the following node combi- 
nations: 1-2-1, 1-2-3, 3-2-1, 3-2-3. Note that the 
order in which nodes appear matters, which, for ex- 
ample, means that iVgs corresponds to the twice the 
expected number of undirected links between two 
susceptible nodes. 

The heterogeneous mean-field equations are high 
dimensional and, therefore, are extremely difficult to 
analyze. A common way to analyze the dynamics of 
social networks is via lower dimensional mean-field 
equations. These can be generated by multiplying 
the heterogeneous mean- field equations by k^ k^2 ^3^ 
for some non- negative integer values of ij , and sum- 
ming over k. Thus, the equations describing node 
dynamics arc obtained by taking ii + J2 + ^3 = 0, 
as given in Eqs. (Bla)-(Blc) of Appendix B, while 
the description of the link dynamics is obtained by 
taking 11+1-2 + is = 1, as given in Eqs. (Bld)-(Bli). 

The hierarchy of equations generated in this man- 



TABLE I. Transitions and nonzero transition rates in 




Eq. (1) 


transition 


rate 


n = (-1,1,0) 


^N:k{ri) = f^S;k(7-i) = flR-kiri) = Aifci 


'^2^(1,-1,0) 


fiiV;k(r-2) = f^S;k(r2) = Slfl;k(r2) = \2k2 


rg = (-1,0,0) 


^N;k{r3) = f^S;k(r3) = ^R-kirs) = Oki 


r4 = (0,-1,0) 


fiiV;k(r-4) = f^S;k(r4) = nR-kiri) = 0/02 


r5 = (0,0,-1) 


!^iV;k(»-5) = f^S;k(r5) = f^fl;k(r5) = ^^fes 


r6 = (1,0,0) 


^N;k{l~6) = f^S;k(r6) = f^fl;k(?-6) = 




= g^/{Nn +Ns+ Nr) 


r7 = (0,-1,1) 


niv;k(r7) = 7^(k), ns;k(r7) = 7Q(k) 


r8 = (0,0,-1) 


f^iV;k(»"8) = Wfca 


rg = (0,0,1) 


f^S;k(r9) = wNkn/Ns 


no = (-1,1,0) 


!^fl;k(rio) = wAfRN/A''s 



A. Closing of NSR and SSR terms 

Wc develop a closure of the A^nsr and Ngsn terms 
by considering the evolution of the expected number 
of node triples in the limit of ^,6,^jl/{Nn + Ns + 
Nr) <^ w, Ai, A2. We consider the following expres- 
sion: 
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This relation is evaluated at the steady state and 
using Eq. (B2a) and (B2b). After some algebraic 
manipulations described in Appendix C, the above 
relation leads to 



ner must be truncated in order to obtain a finite 
dimensional description of the system. Such trun- 
cation leaves the system open and in need of clo- 
sure. For example, the system of node and link 
equations in (Bl) contains the terms A^nsr, ^ssr 
and -/Vrsr, which are higher order structures. The 
usual approach to closure comes from the assump- 
tion of homogeneous distribution of the R-nodes in 
the neighborhood of susceptible nodes, which leads 
to the following closure equations: 



-/VnsR , ^SSR -^SN ^RS , ^SS -^RS 



Ns 



Ns Ns Ns Ns Ns 



(4) 



a result that is consistent with but does not imply 
the closure in Eqs. (2 a) for X ^ N and S. 

We compare the asymptotically derived result of 
Eq. (4) and the ad hoc closure for the A^sSR term in 
Eq. (2a) with the corresponding values measured in 
the Monte Carlo simulations. Figure 2 presents the 
relative error of the two closures 
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A = 



where we also assumed that the degree distribution 
of susceptible nodes is Poisson. The details of these 
closures are presented in the Appendix A. These 
closures are ad hoc and may fail to capture the sys- 
tem behavior accurately if, for example, correlations 
are present. Here we develop an approach that de- 
rives the closure based on the system behavior in 
some asymptotic regime. In particular, we derive 
the equations that describe the evolution of node 
triples, take a steady-state relation and consider it 
in the asymptotic regime, where we are able to close 
the equations. Finally, we numerically explore the 
performance of the derived closures in parameter 
regimes outside of the asymptotic limit and outside 
of the steady-state. 



approximation 



exact value 



(5) 



where simulation measurements are used as the ex- 
act value. We can see in Fig. 2(a) that the ex- 
pected number of NSR and SSR triples per suscep- 
tible node, Nj^sr/Ns + Nssr/Ns, is well approxi- 
mated (error on the order of about 1% or less) by 
the closure of Eq. (4) in the large Ai and A2 limit, 
further improving as w is increased. According to 
Fig. 2(c), the closure of N-^sr/Ns + Nssr/Ns con- 
tinues to hold even in the parameter regime outside 
of the considered limit. As for the individual clo- 
sures. Fig. 2(b) shows that the closure of Nssr/Ns 
holds as well in the large Ai and A2 regime. How- 
ever, as we can see in Fig. 2(d), the closure fails for 
small Ai and A2, especially as 7 becomes dominant. 
Since the closure of Nssr/Ns + Nj<!sr/Ns is derived 
in the asymptotic regime, we expect it to be accurate 
at least in that limit, while Nssr/Ns closure is still 
ad hoc, and, therefore, deviation from simulations is 
not unexpected. 
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FIG. 2. Relative errors in N-msr + Nssb. closure (Eq. (4)) 
(panels a,c) and Nssn closure (Eq. (2a)) (panels b,d) at 
steady state, as a function of 7 for w — lO" (circle, green 
online), w — 10^ (triangle, red online), w = 10^ (cross, 
black online). The simulations are performed following 
the continuous time algorithm introduced in [25]. The 
other parameters are ^ = 1, a = 10, ^ = 10"". 



B. Closure of RSR term 

In order to develop a closure for the N^gR term, 
we consider the expression 



Y^ kldtps-w, 

k 



(6) 



which leads to the equation describing the evolution 
of the expected number of RSR triples: 

dtNRSR = -A2A^RSR - 7^ fc3PS:k(k) + 

k 

AiA^RNR - ONnsR + 7(2A^RSSR + A^ssr)+ (7) 

w^i2Nns + Ns) + e(-27VRSR + A^rs). 

Analyzing the steady state of this equation in the 
limit where 7,6',/i/(iVjv + Ns + Nr) < w,Xi,X2, 
and utilizing the relations in Eqs. (B2a) and (B2b), 
we are able to solve this equation and obtain the 
following relation: 

iVRSR fNns Nb.n\ f ^Nns ^ -^\ , A^rnr 



Ns 



Ns 



N 



N 



)(^ 



Ns 



iV, 



N 



(8) 



Note that, unlike the ad hoc closure of Eq. (2b), this 
result should at least be accurate in the considered 
limit, and, therefore should be more reliable. 



In order to close the ^Vrnr/^w term in Eq. (8) 
we analyze the limiting behavior of the following ex- 
pression: 



y^ klidtpsM + dtPNM] 



which in steady state reduces to: 

-^RNR -^RN , ^RN -^RS 
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Nn Ns 



(9) 



(10) 



Upon substituting the result of Eq. (10) into Eq. (8) 
we obtain the following closure of the N-^sr/Ns 
term: 



^RSR _ „ f Nt^s 



Ns 



Ns 



Nns Nns ^RN 

Ns Ns Nn ■ 



(11) 



In Fig. 3, we compare the performance of the new 
closure of A^rsr in Eq. (11) to the ad hoc, homogene- 
ity based closure of Eq. (2b). We consider the nu- 
merical solution of the mean-field equations, found 
in Appendix B, closed according to the two methods, 
and compare those to the steady-state size of the re- 
cruiting class measured in the direct network simu- 
lations. In both cases, the A^nsr and A^sSR terms are 
closed according to the homogeneity assumption in 
Eq. (2a). Thus, in Fig. 3(a) we see that in the con- 
sidered limit, i.e., when Ai,A2 and w are large, the 
mean- field closed using our approach is in much bet- 
ter agreement with the simulations than the ad hoc 
assumption of Eq. (2b) . The reason for the superior 
performance lies in the better approximation of the 
Nrsr/Ns term, shown in Fig. 3(b). Here N^sr/Ns 
and N-ns/Ns are parametrized by 7, with larger val- 
ues of Ny{s/Ns corresponding to the larger values of 
7. Notice that the performance of the closure is re- 
duced at the larger values of 7, as the system moves 
outside of the considered limit. 

The appeal of this approach is evident when we 
test it outside of the derivation limit. In Figs. 3(c) 
and 3(d) we see that, when we reduce w, the mean- 
field recruited fraction and the RSR closure con- 
tinue to be in a good agreement with the simula- 
tions. We also note that in this limit the new clo- 
sure approaches the homogeneity closure. We note 
that when the rewiring is slow relative to transi- 
tions between N and S, the expected number of R 
neighbors should be similar for the two node types. 
This would make the last term in Eq. (11) approach 
(N-ns/Ns)'^, explaining why the two closures are 
close. In Fig. 3(e), as Ai and A2 are reduced, the 
new mean-field solution appears to be less consis- 
tent with the simulations, which is also reflected in 
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FIG. 3. Recruitment level, Nr, and expected number 
of RSR triples per S-node, Njisr/Ns, as a function of 
recruitment rate 7, for several sets of parameters Ai, A2 
and w. Simulation results are shown by circles (red on- 
line). In (a), (c), (e) and (g), the curves correspond 
to solution of mean- field equations, while in (b), (d), 
(f) and (h) the curves correspond to the approxima- 
tion of N-[iSB./Ns using two different closures. Dark 
curves (black online) correspond to closure in Eq. (11), 
while light curves (green online) correspond to closure in 
Eq. (2b). The other parameters are same as in Fig. 2. 
Note that in Fig. (c), (d), (g), and (h) the curves corre- 
sponding to the two analytic solutions lie on top of each 
other. 



the closure in Fig. 3(f). Finally, in Fig. 3(g) all of 
the parameters are about the same order, and yet 
the asymptotically derived closure and the corre- 
sponding mean-field are very much consistent with 
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FIG. 4. Figure (a) contains measurement and approx- 
imation of Nr. The circles (red online): simulation 
results, the light curve (green online): mean-field with 
homogeneous closure, the dark curve (black online): 
mean-field with asymptotically developed closure from 
Eq. (11). Figure (b) shows the time evolution of the 
number of RSR triples per S-node (circles, red online), 
the approximate value obtained from the relation in 
Eq. (2b) (light curve, green online) and from Eq. (11) 
(dark curve, black online). The simulations are per- 
formed with u> = 10^, Ai = 10\ A2 = 10^ and 7 = 3.0. 
The system evolves from a realization of Erdos-Renyi 
network, with mean degree 10 and 10^ nodes, 85% of 
which are N-nodes, 5% S-nodes and 10% R-nodes. The 
results are averaged over 10 dynamical realizations. 



the simulations. 

Thus far we have shown that our method has pro- 
duced a closure that is a good match for the simu- 
lated system in steady-state, and is cither superior to 
or as good as the ad hoc homogeneity closure. We 
further test the performance of our closure by us- 
ing it outside of steady-state. Figures 4(a) and 4(b) 
show that our closure continues to be consistent with 
the simulations even during the transient period. 
This suggests that the time derivative of A^rsr in 
Eq. (7) can be neglected in the considered limit. 



III. ADAPTIVE EPIDEMIC MODEL 

The other example that we consider is a model for 
epidemic spread on an adaptive social network [10]. 
Here the disease spread is described using the 
susceptible-infected-susceptible model, where each 
individual in the society is in one of the two states: 
sick or infected, and healthy but susceptible to in- 
fection. In the framework of networks, we refer to 
these as I- and S-nodes respectively. The infected in- 
dividuals become susceptible at recovery rate r. The 
disease can spread at a rate p from infected individ- 
uals to susceptible ones via a contact between them, 
where the existence of the contact is defined by the 
network structure. The adaptation mechanism al- 
lows susceptible individuals to change their local 
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FIG. 5. Schematic representation of (a) node dynam- 
ical rules and (b) link dynamical rules in the adaptive 
epidemic model. 




FIG. 6. Schematic representation of four-node chains I- 
S-S-I. The term Mssi corresponds to the expected num- 
ber of such chains. 



TABLE II. Transitions and nonzero transition rates in 
Eq. (12). 



transitions 


non-zero rates 


n = (l,-l) 


n/;k(ri) = QsAn) = rk2 




r-2 = (-l,l) 


ns;k(r2)=pA'(k), n7;k(r2) = 


= pM(k) 


r3 = (l,-l) 


fiS;k(r3) = Wk2 




r4 = (l,0) 


fis;k(r4) = wNis/Ns 




r-5 = (-l,0) 


^I;k{r5) = wki 





connectivity to avoid contact with infected individ- 
uals. Thus, the susceptibles rewire their contacts 
away from infecteds at rate w, connecting instead 
to a randomly chosen susceptible. The node and 
link dynamical rules are summarized in the Fig. 5(a) 
and 5(b) respectively. 

The evolution of the ensemble average of such 
a system is described by the set of heterogeneous 
mean-field equations: 

dtPsM = rpi-u -pk2PsM+ 

i 

dtPi-M = -rpi.]^+pk2ps-k+ 

i 

where the value of psM (value of pi.k) corresponds to 
the number of S-nodcs (I-nodcs) with fci of S-nodes 
and ^2 of I-nodcs in their neighborhoods, with k = 
(^1,^2). The function K (function M) corresponds 
to the expected number of node chains that originate 
at an S-node (I-node) with a neighborhood specified 
by k, which connects to an S-node, which in turn 
connects to an I-node. The functions iVxi...x„ are 
defined in the same way as in Section II. 

The mean-field equations are generated by mul- 
tiplying the heterogeneous mean-field equations by 
k^ik2 and summing over k, where ii and 12 are non- 
negative integers. Thus, two node equations are gen- 
erated for ii +12 = 0, and three distinct link equa- 
tions are generated for 11+^2 = 1. These equations. 



presented in the appendix as Eqs. (Dla)-(Dle), are 
open due to dependence on terms describing the ex- 
pected number of ISI triples, TVisi, and SSI triples, 
A^ssi. In order to close this system of equations, 
additional information is required. Once again, the 
usual approach [15] is to make an assumption that 
infected nodes arc homogeneously distributed in the 
neighborhood of S-nodes, an assumption that leads 
to the following closure: 



iVssi N^s Nis 



Ns 

Nisi 
Ns 



Ns 

Nis 
Ns 



Ns 
2 



Njs 

Ns' 



(13a) 
(13b) 



where we make an additional assumption that the 
total degree distribution of susceptible nodes is Pois- 
son. More details can be found in Appendix A. 

We derive a new closure of the ISI term by 
first considering the evolution of the number of ISI 
triples. Multiplying equation (12a) by fc| and sum- 
ming over k at steady state. 



Y. kjdtPS:i, - 0, 
k 

we obtain the following equation: 
= rAriii-p^[fc3ps.k] + 

k 

+ {r + w)[~2Nisi + Nis] +p[2iVissi 



(14) 



(15) 



N 



ssij 



where the four-point term IS SI corresponds to 
the total number of node configurations shown in 
Fig. 6. Using the steady-state relations in Eqs. (D3a) 
and (D3b), we arrive at 



2ir + wjNs 

^ ' ^ Ns Ns Ns Nssi J 



rN, 



Nlll ^IlEk[fc2PS;k] 



Ni Ni Y.^MPS■M\ 



(16) 



The left hand side of the equation corresponds to 
the flux of the expected number of ISI triples due 



to the changes in the neighborhood of the suscepti- 
ble nodes, while the right hand side corresponds to 
the flux due to the infection and recovery of the sus- 
ceptible node in the ISI triple. In the limit of large 
infection rate and weak rewiring, the amount of time 
any node spends in the susceptible state approaches 
zero. Therefore, it is reasonable to assume that the 
flux of triples due to the changes in the neighbor- 
hood of the susceptible node will approach zero as 
well. This leads us to conclude that the two sides 
of Eq. 16 must vanish, leaving us with the following 
relation: 



iVisi 
Ns 



N^.N, 



IS JVjssi 



Ns ^ Ns Nssi 



(17) 



Finally, we note that the term A'igsi/iVssi corre- 
sponds to the expected number of I-nodes, node 1 in 
Fig. 6, attached to the chain of nodes numbered 2, 
3 and 4 in that figure. This relation is well approxi- 
mated by the homogeneity assumption, that the in- 
formation about the neighborhood of the 3rd node 
in Fig. 6 has no effect on the information about the 
neighborhood of the 2nd node. In other words, the 
following moment closure is considered: 



N 



ISSI 



N 



SSI 



Nssi -^ss 



(18) 



In other words, we make a homogeneity assump- 
tion about the neighborhood of a neighbor, and we 
expect this assumption to be more accurate than 
the same assumption about a given node's neigh- 
borhood, i.e., the closures in Eqs. (13a) and (13b). 
Thus, we have derived a new closure of A'igi: 



A^isi ^ Nis NisNssi 
Ns Ns Ns Nss ' 



(19) 



which relies on our ability to close the A^ssi term, 
and this brings us one step closer to finding an ac- 
curate closure of the mean-field description of the 
adaptive epidemic model (Dl). Curiously, the ho- 
mogeneity closm-e of iVssi in Eq. (13a), together 
with Eq. (19), leads to the homogeneity closure in 
Eq. (13b). Thus, as is suggested by Figs. 7 and 8, 
where the measured values of A^ssi are used, improv- 
ing the closure of A^ssi beyond the homogeneity as- 
sumption leads to improvement of the A^isi closure. 
In fact, Figs 7(b), 7(d), 7(f) as well as 8(b), 8(d), 8(f) 
show the relative deviation of the closure relations 
from the approximated quantity and suggest that 
the new approximation in Eq. (19) is superior to 
the relation in Eq. (13b). Note that the only time 
the homogeneity closure appears to perform better 
is when it intersects the measured value of Nisi/Ns, 




10" 



< ^o^' 



1 10 1 



10' 



w/r 
(a) p/r = 10-1/2 



w/r 
(b) p/r = 10-1/2 




10'^ 



< 10"' 



10"' 10' 

w/r 
(c) p/r = ICP 



oooo ■\Q~ 



10"' 10' 

w/r 
(d) p/r = 10" 




10"' 10 

w/r 
(e) p/r = IQi 



FIG. 7. Number of ISI triples per S-node as a func- 
tion of rewiring rate, for several infection rates: simu- 
lations compared to tlie moment closures of Eq. (13b) 
and Eq. (19). Figures (a), (c), and (e) show Nisi/Ns 
measured in simulation (circles, red online), approxi- 
mated using homogeneity closure of Eq. (13b) (light 
curve, green online), and approximated using the result 
of asymptotic analysis in Eq. (19) (dark curve, black on- 
line). The closures are evaluated using node and link 
quantities measured in the simulations. Light curves 
(green online) in figures (b), (d), and (f) show the relative 
error, Eq. (5), of the homogeneity approximation, while 
dark curves (black online) show the relative error due to 
the newly derived approximation. Cusps in the relative 
error curves correspond to the Nisi/Ns homogeneity clo- 
sure curve crossing through the curve measured in sim- 
ulations. Simulations are performed on a network with 
IC nodes and 5 x IC links following algorithm in [25]. 



and, therefore, its superiority over the performance 
of the new closure is rather coincidental. Further 
consideration of the results in Fig. 7 shows that, as 
we move away from the derivation regime of slow 
rewiring rates, the performance of the new closure 
diminishes, though it is still superior to the old ap- 
proximation. Predictably, as shown in Fig. 8, the 
performance of the new approximation improves for 
the larger values of infection rate, and outperforming 
the original closure even near the epidemic thresh- 
old. 
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FIG. 8. Number of ISI triples per S-node as a function 
of infection rate, for several rewiring rates: simulations 
compared to two approximations. The curves and circles 
are defined as in Fig. 7, with the same network size and 
number of links. 



Finally, we test our new closure outside of the 
steady-state. Thus, Fig. 9(a) compares the perfor- 
mance of the newly derived approximation to that 
of the homogeneity approximation. We can see that, 
unlike the homogeneity closure, the new closure fol- 
lows the measured values of Nisi/Ns very accu- 
rately. Furthermore, as shown in Fig. 9(b), the clo- 
sure of Eq. (19) performs better as the solution ap- 
proaches the steady-state. 



IV. DISCUSSION 

We presented an approach for closing a mean-field 
description of dynamical network systems. In our 
approach we proposed exploiting the possible sim- 
plification of the heterogeneous mean-field descrip- 
tion of the system in some asymptotic regime. We 
applied this approach to two examples of adaptive 
networks: recruitment to a cause model and a model 
of epidemic spread on an adaptive network. Using 
the two examples, we successfully developed closures 
that perform as well as or better than the usual elo- 




FIG. 9. Time evolution of ISI closure. Fig. (a) shows the 
time evolution of the number of ISI triples per S-node 
(circles, red online) and the approximate value as ob- 
tained from the relation in Eq. (13b) (light curve, green 
online) and from Eq. (19) (dark curve, black online). 
Fig. (b) shows the relative error due to the two approx- 
imations. The simulations are performed for w = IQ-^, 
p = 10°, r- = 1, 10^ nodes and 5 x lO'' links. The initial 
network is a realization of an Erdos-Renyi random net- 
work; the state of each node is randomly assigned, with 
90% I-nodes and 10% S-nodes. We take the average over 
100 dynamical realizations. 



sures, which are based on the assumptions of homo- 
geneous distribution of nodes throughout the net- 
work. 

The closure we developed for the recruitment 
model showed significant improvement of the mean- 
field description over the one where all of the high 
order terms were approximated using the homogene- 
ity closure. Not only do we see an improvement 
in the predicted levels of the recruited population; 
we also see greater consistency between the moment 
closure approximation and direct measurements of 
the closed terms. Thus, out of the three node-triple 
terms that we approximated, one showed significant 
improvement over the homogeneity based closure, 
and the sum of the remaining two triples proved to 
be consistent with the homogeneity closure. 

In case of the epidemic model, the closure devel- 
oped with the asymptotic approach also showed im- 
provement over the ad hoc, homogeneity based clo- 
sure. The result of utilizing our approach was an 
improved moment closure approximation for one of 
the terms, contingent on improvements of a closure 
for the other term, as confirmed by the numerical 
simulations of the adaptive system. 

It is important to note that the closures that we 
derived in some asymptotic regimes proved to be 
more accurate than the homogeneity closures even 
outside of the derivation limit. For example, even 
though in both eases the closures were derived at 
steady-state, they showed excellent results outside of 
the asymptotic parameter regime where the deriva- 
tion took place, as well as during the transient state 



of the dynamical process. The additional benefit of 
using this approach is that it allows us to expect 
good performance of the closure at least in the limit 
where the derivation took place, more than can be 
said about any ad hoc moment closure approxima- 
tion. However, the more rigorous statements about 
the accuracy of this approach as well as the appli- 
cability of this approach to a more general class of 
network problems are left to the future investiga- 
tions. 
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translates into the following relation: 
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In order to close the term describing the expected 
number of RSR triples per S-node, additional in- 
formation about the total degree distribution of S- 
nodes, Ps;no j is required. We make an ad hoc as- 
sumption that the distribution is Poisson: 
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Appendix A: Homogeneity Closure 

The homogeneity closure is based on the assump- 
tion that the probability of finding an R-node at the 
end of a link that stems from an S-node is indepen- 
dent of what else is in the neighborhood of that S- 
nodc and is given hy q = iVRs/(A^RS+A^ss+-/VsN)- In 
other words, the probability for the S-node to have 
r of R-nodcs in its neighborhood is assumed to be 
independent of the number of X-nodes in the neigh- 
borhood where X represents the other node types: 



S:nR\nx 



ir\x) = Ps-.n^ir) 



(Al) 



where P5.„^|„^(r|a;) is the probability r of the R- 
nodes are in the neighborhood of the S-node condi- 
tioned on the presence of x of the X-nodes in the 
neighborhood of that same S-node, and Ps-.na (f) 
is the probability distribution of the number of R- 
nodcs in the neighborhood of S-nodes. Note that 
this consideration is for X ^ R. 

When the expected number of XSR triples per 
S-node is evaluated, the homogeneity assumption 



Ps:nnid) 
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(A3) 



which would be the case had the links between the 
nodes been formed in a random fashion. Here the 
mean of the distribution is known and given by 
a ~ (A^sN + ^ss + ^Rs)/^s- The homogeneity 
assumption on the distribution of R-nodes implies 
that the probability that an S-node with total de- 
gree d has r of the R-nodes in its neighborhood, 
P5.„^l„j-, (r|d), is given by the binomial distribution: 
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The expected number of RSR node triples per S- 
node is now evaluated as follows: 



Nk 



,SR 



Ns 



= E^'^s;»hW 



Y.'-^Ps;nR\nuir\d)Ps:noid) = 
r.d 

Y,[idqf + dqil - q)]Ps,nn{d) ^ 



d 



(A5) 



q'ia- + a)+q{l-q)a 



2 2 

q (J + qa ^ 



Ns 



N 



RS 



Ns 



The same approach leads to the homogeneity clo- 
sure in the SIS model, where we replace recruiting 
nodes by infected nodes. 



Appendix B: Mean-Field Equations for 
Recruitment with Adaptation 



The following mean-field equations are found by 
multiplying Eq. (1) by k^k^kl^ with ii + i2 + «3 = 



0,1: 



dtNN = H- XiNn + AaA^s - ONn, (Bla) 

dtNs - XiNn - X2NS - -/Nrs - ONs, (Bib) 
dtNR = jNns - ONr, (Blc) 

-2(Ai+0)7Vnn, 

I\n + ^Vs + I\r (Ble) 

- 7A^NSR - (Ai + A2 + 26i)A^sN + AiTVnn, 
dtNss =- -2-/NssR + 2AiiVsN 
-2{X2 + 0)Nss, 

Nr 

^'"^^^ = ""^ N.+Ns + Nr + ^^^^^ (Big) 



(Blf) 



- (Ai + 20 + w)NnN + AaA^Rs, 
dtNns = -7^RSR + 7^ssR 

- (A2 + 26i)iVR,s + (Ai + w)NnN, 
dtN^R = 2-fNnsR - 20NnK. 



(Blh) 

(Bli) 



At steady state, in the limit where ^,6, ii/{Nn + 
Ns + Nr) < w,Ai,A2, Eq. (Bib) and Eq. (Blh) 
lead to the following relations: 

AiiVAT = A2A^s, (B2a) 

(Ai+u;)iVRN-A2A^RS. (B2b) 

Note that here we do not take into consideration the 
fact that all of the terms -/VxiX2...x„ are functions of 
the system parameters. For example, we implicitly 
assume that Ai , A2 and w can be chosen large enough 
such that 7A'rs ^ X2Ns,XiNn in the considered 
limit. 



Appendix C: Derivation of the A^nsr + Nssr 
closure. 



To obtain a closure of the A^nsr and Nssr terms 
in the recruiting model, we consider the expression 



\Ns N 
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Nn iV, 
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(CI) 



which should be at steady state. Discarding quan- 
tities proportional to parameters 7, 0, jjl/^Nn + Ns + 
Nr) (which are assumed small relative to other pa- 
rameters), we find that the quantity in the first term 



of (CI) simplifies to 

y^ (ftpsikfcifcs) = -A2A'nsr + Ai7Vnnr+ 

k 

+ E [Ai(fci + l)kik^psM-rx - Xik\kipsM+ 

k 

+ A2fcl(fc2 + l)fc3/3S:k-r2 - X2kik2k^ p s ■\^+ 

Nrm-. 



+w^r^kik3ps-k-r3 



w—-—kik'ips-] 



Ns ' -'■■'^^-"' Ns 

A2A^NSR + AiA^NNR — AiA^NSR + A2AfssRr 

iVRN 



Ns 



-N 



SN 



(C2a) 



using the fact that '^y-kik^ps-^k 
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NSR, 



N^ 



etc. Other terms in (CI) 



sum similarly. 

We use Eq. (B2a)-(B2b) to eliminate parameters 
A2, w from the expression (CI), replacing them with 
combinations of Ai and node and link variables. This 
yields 
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and 



AiA^. 



T^ Y] [dtPNMkiks + k2k3)] = -^ 

I\n , JV5 



JVrs Nn JVnnr , Ni 
Ns iVRN N, 
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SSR _ ^rs Nn Nsnr 

Ns Ns iVRN Nn 
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Combining these quantities as in (CI) and setting 
to for steady state finally yields 



^1 



NSR 



A^ssR NsN Nrs Nss Nrs 



Ns Ns 

Nrn Nrs 



Ns Ns Ns Ns 
-0, 



or 



A^NSR , -^SSR NsN Nrs Nss A^'rs 



Ns 



Ns 



Ns Ns Ns Ns 



(C5) 



(C6) 



10 



Appendix D: Mean-Field Equations for SIS with 
Adaptation 



The mean-field equations generated from tlie Iret- 
erogcneous mean-field equations (12a) and (12b) are 



the following: 



dtNs ^ rNi - pNis, 
dtNi :^ -rNi + pNis, 
dtNss - -2piVssi + 2(r + w)Nis, 
dtNis = rNu - pNisi+pNssi 
- {r + w)Nis, 
dtNu = -2rNu + 2pNisi 



(Dla) 
(Dlb) 
(Die) 

(Did) 

(Die) 



The conservation equations for nodes and links are: 



Ns + Ni = N, 
Nss + 2iVis + Nu 



Na, 



(D2a) 

(D2b) 



where N is the total number of nodes, and a is the 
mean degree. At steady-state the mean-field equa- 
tions give the following relations used in the body of 
the paper: 



pNssi = {r + w)Nis, 
pNisi = rNu. 



(D3a) 
(D3b) 
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